Multimodal Communication with Robots and Virtual Agents
نویسنده
چکیده
The purpose of this project is to develop a platform for human-robot and human-humanoid interface. One application of this platform is to study the impact of the feedbacks provided by the robot and the humanoid on the interaction. Several studies have shown the benefit of verbal and non-verbal analysis and synthesis for the improvement of Human-Agent Interaction and of HumanRobot Interaction (HRI). But very few studies have been conducted to compare both interaction types. In particular we aim to study how the differences in embodiment (physical vs. virtual, few expressive parameters vs. subtle expressiveness) can affect how humans interact with the device.
منابع مشابه
Multimodal Representation of Personified Media with Expressive Strengths of Voice and Gesture
The purpose of this dissertation is to propose and investigate multimodal expression of personified media, with multiple modalities, focusing on the expressive strength of voice and gesture. The results are expected to be used in a practical construction of personified representation. There are many of research works on and products of, personified media such as educational puppets, humanoid ro...
متن کاملEngaging in a Conversation with Synthetic Characters Along the Virtuality Continuum
During the last decade research groups as well as a number of commercial software developers have started to deploy embodied conversational characters in the user interface especially in those application areas where a close emulation of multimodal human-human communication is needed. Most of these characters have one thing in common: In order to enter the user’s physical world, they need to be...
متن کاملAchieving Multimodal Cohesion during Intercultural Conversations
How do English as a lingua franca (ELF) speakers achieve multimodal cohesion on the basis of their specific interests and cultural backgrounds? From a dialogic and collaborative view of communication, this study focuses on how verbal and nonverbal modes cohere together during intercultural conversations. The data include approximately 160-minute transcribed video recordings of ELF interactions ...
متن کاملMultimodal Communication in Inhabited Virtual Environments
This paper reports on ongoing research of various aspects of multi-modal interactions in a Virtual Reality environment in which visitors can interact in diverse ways with agents and objects in the environment. The virtual environment is a copy of a theatre and is inhabited by both embodied and non-embodied agents that can assist the visitor: providing information about the performances, selling...
متن کاملTasking Robots through Multimodal Interfaces: The "Coach Metaphor"
This paper presents multimodal interfaces to task and control multiple robots controlled by an agent-based architecture. For the past few years, SRI International have followed an approach based on the “Coach Metaphor”. In sports or business, coaches are meant to apply predefined strategies to their teams, or, if something goes wrong, to find new means and plans during an ongoing game, so as to...
متن کامل